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ABSTRACT 


This report deals with the development and utilization of a maximum 
likelihood tracking algorithm designed to handle a single diffusing 
target. The tracker is required to accept or reject each of a sequence 
of discrete position reports, some of which are false alarms. Average 
tracking time, E(T), is defined and used to evaluate tracker performance. 
The effects of tracker memory are examined and a Kalman filter is 


developed to handle the effects of measurement error. Simulation 


results are included. 
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IT. INTRODUCTION 


The treatment of false alarms is central to the development of any 
useful set of tracking decision rules. The purpose of this report is 
to examine the effectiveness of a specific tracking algorithm to be 
used in the presence of false alarms. A maximum likelihood decision 
rule will be developed and used in conjunction with an expandable 
tracker memory. The primary measure of tracker effectiveness will be 


average tracking time, E(7). 


A. BACKGROUND 

Every tracking system must in some way account for the possibility 
of receiving both real and false target position reports. Tracking 
radars typically employ a ‘gate‘ criterion that rejects position re- 
ports which differ significantly from what target dynamics might per- 
mit. The gate helps to maintain track in a relatively noisy environ- 
ment at the expense of occasionally rejecting a real detection. 
Surveillance systems with data rates considerably below those of 
tracking radars, such as might be found in an ASW environment, must 
also deal with false detections, and these will be the subject of 
this report. 

Tracking systems with low data rates must necessarily take a dif- 
ferent approach than a typical aircraft tracking system might employ. 
Most rapid rate tracking systems are judged by their ability to 


recognize and differentiate new tracks, crossing tracks, split tracks, 








and fading tracks. They must be able to process large amounts of in- 
formation, quickly and efficiently, to produce precise target position 
estimates on a real time basis. In his article ‘An Optimal Data Asso- 
ciation Problem in Surveillance Theory' Robert Sittler developed a 
maximum likelihood model for just this purpose. 

In a situation where the data rate is low, the emphasis shifts from 
how well we track to whether we can track at all. We will look ata 
particular class of trackers that maintains an estimate of target posi- 
tion at all times, and for which it is therefore possible to define 
tracking error at all times. 

Figure 1 illustrates the results of three separate tracking se- 
quences using the maximum likelihood memoryless tracker developed in 
this report. In the figure, error is measured in units of length and 
used to represent the difference between the target's real position 
and the tracker's estimated position of the target at any particular 
time. Due to the discrete nature of the target position reports used 
in the simulation, error is measured accurately only at the positions 
marked with a -. In all cases the error initially fluctuates up and 
down, but finally grows very rapidly. We wish to identify a “tracking 
time" that marks the end of the fluctuation region, and to define a 
tracking scheme that makes the average “tracking time" as large as 
possible. As figure 1 shows, a precise definition of tracking time 
can be illusive, and we will therefore define a conservative measure 


later in this chapter. 
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Figure 1. Time vs error plot for 3 sample runs of the maximum 
likelihood memoryless tracker. 
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3. PROBLEM DYNAMICS 

We consider an abstract two-dimensional version of the tracking 
problem. Real target position reports arrive randomly, according to 
a Poisson process with data rate X [units are aes ae In a process 
of this kind, reports are equally likely to arrive at any point ina 
fixed interval. It is not possible to identify real detections by 
their time of arrival or the interval between arrivals. 

Target motion is assumed to be due to normal diffusion with no 
drift. A diffusion constant D [units are (Tength® x time” ')] will be 
used to characterize a single target's motion. Motion of this type 
can be modeled with a bivariate normal distribution. Ina situation 
with no false alarms or measurement error, the target density would 
have the physical shape of a tall mountain centered on the last target 
position report. The mountain spreads gradually in all directions as 
the interval between detections increases, much like a mountain of snow 
melting under the sun. The motion of Fleet Ballistic Missile Sub- 
marines on patrol is often modeled with this type of distribution. 

Tracking systems are often prone to some inherent measurement 
error. Many systems will have an internal bias in one direction, 
around which a detection might be likely to occur. In this report 
we will consider the case in which that type of bias can be recognized 
and accounted for. We will assume that the reported target position 
has a circular normal measurement error with standard deviation o 
[units are (length) in each direction], and will be centered on the 


actual target position. 








In most tracking systems there exists the possibility of a detec- 
tion occurring in a location where no target exists. Ina radar sys- 
tem it may be due to a random electrical disturbance, or with sonar, 
due to a transient school of fish. In this model, any detection not 
associated with the single real target will be called a false alarm. 
Every position report will therefore require classification as either 
a target contact or a false alarm. The case where other ‘trackable’ 
objects are present will not be considered. 

False alarms will be considered to occur according to a space-time 
Poisson process with rate n [units are (length® x eine. This re- 
sults in false alarms occurring uniformly over an area with time 
Spacing of events being governed by a Poisson process. This type of 
detection process can be assumed to arise from random disturbances to 
the system or from real but rare detections on other objects. 

The assumption will also be made that there is no discernable dif- 
ference between false and real detections. This assumption can be 
considered highly pessimistic when compared to any existing tracking 
System. The result is to drive the average tracking time toward a 
lower bound. 

We have used four parameters, D, A, n, and o, to characterize the 
dynamics of the tracking problem. Since there are only two dimensions, 
time and length, actually involved, we can summarize the problem with 


two dimensionless summary measures. These are: 


a = A/Y2mD = rate ratio 
B = o/YD/XA = accuracy ratio 
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C. TRACKER MEMORY 

The concept of memory raises several possibilities when applied to 
tracking systems in general. Qualitatively, an expanded memory would 
seem destrable, but must be assumed to incur an additional cost to the 
tracker. Two questions addressed in this report are how much memory 
is needed and in what way should memory be used. 

First we address the simplest tracking problem in which a single 
decision is made following each detection. Tracking begins with a 
known real target detection. Each subsequent position report is evalu- 
ated as real or false instantaneously. If evaluated false, the detec- 
tion will be forgotten and the problem will continue. If evaluated 
real, the problem will be updated and restarted from the target's new 
position estimate. Tracking time is considered to stop at the time of 
the tracker's first mistake; i.e. 

1) Tracker accepts a false alarm as real. 

2) Tracker rejects a real detection. 

These rules apply to what will be called the memoryless tracker. 

Figure | shows the results of three separate tracking sequences 
Simulated with the maximum likelihood memoryless model developed in 
this report. The time of the tracker's first mistaken identification 
1s marked with a @ in each case. Also marked with a © is the last 
time, within the allotted simulation time, that the tracker correctly 
identified the real target. From the sample cases shown it is not 


clear that the tracker has actually lost his tracking ability after 


1] 









making only one mistake. The tracker demonstrates an apparent ability 
to reacquire the target in some cases. It is clear though, that there 
is a point in time beyond which error will generally continue to in- 
crease. Any reduction in tracker error beyond this point can be con- 
sidered to be almost exclusively due to the random chance that the 
target might walk back into the tracker rather than due to tracker 
efficiency. A problem arises however because of the fact that there 
is some positive probability that at some time in the future, the 
tracker might accidentally reacquire the target. A trivial tracker 
could, in fact, extend the tracking time indefinitely by accepting al] 
detections that occur and defining tracking time to end at the time 

of the last correct identification. For this reason, we will use E(T), 
the average time till the tracker makes his first mistake, as our 
Summary measure of tracker effectiveness and consider it a useful 
lower bound on actual tracking time. 

The tracker with memory will face the same task and its performance 
will be judged in a similar manner. We look first at the case where 
the accuracy ratio, 8, equals zero. In the diffusing target scenario, 
future target positions can then be considered to be independent of al! 
but the real target's present position. Reports received prior to the 
most recent target detection will, therefore, not be retained in 
memory. Rather than demand an immediate decision on subsequent detec- 
tions, however, the tracker with memory will be given the opportunity 


to file a finite number of detections in memory for a future decision. 
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Following each detection he will decide whether any single subset of 
detections on file constitutes the actual target track. If the de- 
cision is yes, memory will be scrubbed of all but the most recent posi- 
tion estimate and the process will begin again. When no track has 

been accepted, the tracker will retain all detections on file until 

his memory capacity is exceeded. As additional reports are received 

he will sequentially scrub detections on file according to a prede- 
termined rule to be discussed later. 

In the sttuation where the accuracy ratio, 8, is not equal to zero, 
the problem is handled in essentially the same way. Successive real 
target detections are not independent of previous ones however, and 
will require special handling. This case will be dealt with in 
chapter 4. 

So that effectiveness of the memoryless tracker and the tracker 
with memory may be compared, tracking time will be defined in essen- 
tially the same way as before. The tracker with memory will begin at 
time zero with a known real target detection and end when he makes his 
first mistake. Mistakes occur in any of the following ways: 

1) A false alarm is included in an accepted set of detections. 

2) A real detection is omitted from an accepted set of detections. 
Tracking time is stopped at the time associated with the mistaken 
detection, which may be earlier than the time at which the fatal 


decision is made. 









In the next chapter, we will develop the theory and specific 
decision rules for what will be called the maximum likelihood tracker. 
To simplify the analytic solution, measurement error will not be con- 
Sidered in that chapter or the next. In chapter 3 we will examine 
the results of a maximum likelihood tracker simulation and compare 
the results with those of Washburn [3]. A memory capacity will be 
given to the tracker in this chapter and its effect will be analyzed. 
In chapter 4 we will introduce and deal with measurement error. 


Chapter 5 will focus on the conclusions of this report. 











IIT. MAXIMUM LIKELIHOOD DECISION RULE 


In classical stattstics the maximum likelihood estimator is typi- 
cally used to estimate the value of a distributional parameter that 
has maximum chance of producing a sample result. In the study of a 
time-sequenced series of events the same concept can be applied. The 
subject of this chapter will be to develop a simplified decision rule 
that reflects the concept of maximum likelihood. The motivation lies 
behind the idea of labeling any series of detections in such a way as 
to maximize the probability of that set of labels being correct. The 
Subset of detections labeled real in a series of detections could 
also be called the target track. The final result will be a simple 
Summary measure by which every series of detection labels can be com- 


pared. Only the most likely series of events will be accepted. 


A. SUMMARY OF TRACKING RULES 

The problem of evaluating a single detection is particularly 
adaptable to a maximum likelihood model. We need only compare the 
probability of the detection being real against the probability of 
its being false. Given the characteristics of the diffusing target, 
this problem will yield easily to analysis. 

When a series of K detections must be considered, the problem 
escalates in difficulty but follows the same basic principles. All 


possible combinations of real and false detection labels must be 





compared. The combination of labels that holds the greatest chance of 
being correct would be accepted as real. The label combinations would 
be bounded by the set where all detections were labeled false as well 
as by the set where all were labeled real. All combinations within 
those bounds would have to be examined. 

With this type of tracker it would be theoretically possible but 
practically unmanageable to retain all detections on file for future 
re-evaluation, even after they may have already been accepted. For 
the purposes of this report, the tracker will not be permitted to 
reconsider past decisions. The tracker can only progress from the 
last accepted decision. 

The magnitude of this problem increases dramatically as additional 
detections are added to tracker memory. At each step the number of 
possible combinations which must be considered actually doubles. 
Accordingly, the size of tracker memory quickly becomes an issue of 
critical concern. 

To simplify the analysis somewhat, the tracker's circular normal 
measurement error will not be considered in this chapter or the next. 
The inclusion of measurement error serves to complicate computer im- 
plementation of the decision process, although the maximum likelihood 
rules remain essentially unchanged. The case where measurement error 
is not zero will be dealt with in chapter 4. 

To summarize the tracking rule that will be developed in the 
remainder of this chapter, we will first define a new concept for 


distance. Any two detections will have a dimensionless "distance" 
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between them equal to cr°/(2Dt)] + In(2m Dt/A) where R is the physical 
distance and t is the time difference between detections. A "track" 
then, will simply be a set of detections connected in order of occur- 
rence, and the most likely track is the one with the shortest total 
distance. Note that the distance can be negative so that the best 
track is not necessarily null. In fact, the null solution corresponds 
to case where every detection is evaluated as being false. The rule 
presented here is actually a special case of the tracking scheme 


developed by Sittler [2]. 


8. DEVELOPMENT OF TRACKING RULES 

To begin the analysis we consider a discrete approximation to the 
problem. We will assume time is discrete with intervals of length A. 
Space will be considered to be made of discrete sections with area of 
size 6. Figure 2 illustrates a possible sequence of two events in 
Space and time. Although figure 2 shows only one dimension of space, 
X, a second dimension, y, will also be considered in the mathematics 
that follows. With two detections on file we must consider labeling 
the events in one of four possible ways 

1) Detection one is real, two is false 

2) Detection one is false, two is real 

3) Detection one is real, two is also real 

4) Detection one is false, two is also false 
The likelihood of any of these label patterns or tracks can be ex- 


pressed with a combination of the following expressions: 
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Figure 2. Sample space-time plot for two detections. 


P[Real detection occurs at (X,,¥,) at time t.] 


(8/(2nDt. Jexpl-X,+¥,°) 20t.)]) (4) (1) 


P(False alarm occurs at (X.Y) at time tJ 


(6/A)(nAA) = dnd (2) 


The first factor in expression (1) is simply the normal density func- 
tion for a diffusing target multiplied by the elementary area 6. It 
represents the probability that the target is within a given elementary 


area at a specific time. The variable t. is actually n.d, where n. 1s 


18 


the number of time intervals, A, since the last detection labeled real 
in the series. N will be the total number of time intervals, A, in- 
cluded in the set. The word ‘at' is being used loosely to indicate a 
detection within an elementary space and time interval. x and Y; are 
the rectangular distances from the last detection considered real in 
the series. The second term in the expression is the Poisson proba- 
bility of a real detection occurring in a specific elementary time in- 
terval A. 

Expression (2) is the false alarm equivalent to expression (1). 
To avoid the issue of boundary conditions, in expression (1) we must 
define the area, A, in expression (2), to be large enough to effective- 
ly negate any possibility of the target reaching a boundary before 
either the tracker loses track or is able to reinitialize the problem. 

Referring back to the four possible label combinations, the proba- 


bilities for each of these events can be expressed as follows: 


Poe P[R.D. in $, when n, °A= t,]-PLF.D. in 5, when no-A = to] 

- P[No R.D. in (N-1)A's]*P[No F.D. in (N-1T)A's] (3) 
Eo P[F.D. in 6; when n, +A = t, J+PCR.D. in 6. when n,°A= tod 

¢ P[No R.D. in (N-1)A'’s]*P[No F.D. in (N-T)A's] (4) 


oO 
1 


3 P[R.D. in 6, when n,°A = t,]-PCR.D. in §, when n,*A= to] 


- P[No R.D. in (N-2)A's]*P[No F.D. in (N) A's] (5) 
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ae = P[F.D. in 6, when n)°A = t,]+PLF.O. in 6, when no = to] 


- P[No R.D. in N A's] + P[No F.D. in (N-2)A's] (6) 


Then expressing (3) and (5) analytically we have: 


wu 


[(AA) +6/(2nDt, Jexpl-(X “#¥, °) /(20ty ) 11 


T/A-1 


- [(nAb)(6/A) [1-28] Ci-naay!/4-! (7) 


uw 
il 


3 [(aA) +6/(2nDt, Jexpl-(X, #¥, °) /(20t, ) I] 
+ [(2d)(6/(2nDt,) expl-(X,“#¥5°)/(20t,) I] 


mee Tynan! /4 (8) 


where T = NA is the total time being considered. The remaining 
terms can be expressed in similar fashion. 

The task now is to find a way in which to compare the various 
analytic probabilities. It can be seen immediately that each of the 
expressions will contain a number of equivalent factors. 

Shifting momentarily to the general case, we will consider the 
Situation where there are K detections in the set, m. of which are 
being evaluated as real in track (a) and m, of which are being evalu- 


ated as real in track (b). The likelihood ratio of the two tracks is 
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m 
BGA = TT 6/(2n0t. .) expl-(X,.“#Y, .°)/(20t, .)] 


p 1 


a. el 
b =. ob 
? 
[(a} ° TT s/(2ndt,,) expl-(X, ,+¥, 5°) /(20t, .)] 
j= 


— £¢3/A) 3 (naa) "87 (rena OMe (renaayT/O-(K-a, ) 


K- Ke- ; 
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which reduces to 


mM 
d 
m K-m 
(na) * PT] oy(2not, ;) expl-(x, ,°#¥, ;°)/(20t, )](sna) 
i=] 


p 
a 
b m mb K=m 
b 2 Z b 
L(Ad) | | 6/(2nDt, .) expl-(X,, ; wis )/(20t, 5) }(snd) 
Jet 
NE m oie 
meer «6° 6(1-=nAA) ° (10) 


The subscripts on X, Y, and t have been changed to indicate that there 
are different values associated with the terms from different paths; 
Xj is the X-coordinate of the iTH detection on Peek (a), etc. Note 
that when A is small the last two factors in equation (10) are approxi- 
mately equal to the value one. We will make this approximation, and 


by further cancellation we obtain 
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m 
a 


m 
(xn) TT Canoe.) expl-(x, 5 4¥, 5) /(20t, 5) 
—————— eS EE (11) 


m 
b 
m 
(xin) PTT 1/(2nbty 5) expl-Cry 5 ¥y, 5) /(20ty 31] 
j=l 


which suggests a useful decision rule. Note that the quantities A, 
A, and o do not appear. Each term in the expression is either known 
or can be measured. A decision rule would be to pick track (a) if the 
ratio was greater than one, or pick track (b) if the ratio was less 
than one. The comparison could be carried out for all possible 
tracks in the set of detections with the winner being declared most 
likely. The method is intuitively reasonable and easily implemented 
by computer as long as the maximum number of possible tracks remains 
small. 

For simplification, it is convenient to use the logarithmic form 
of equation (11). Let Li=In Pi. Then Pi>Pj if and only if Li<Lj. 
The rule then would be to pick the track with the smallest value Li. 


The final summary measure for track (a) will be 


a 


L. >> (x, ,#¥,.*)/(20t, .) + In(2mdt, ./A)] (12) 


i=] 


The criterion for track acceptance will be, accept the track with the 
smallest value Li. The case where all detections are labeled false 


will have the value zero. In this way we are actually choosing to 


Ze 








label the observed series of events with the pattern of detection types 
that is most likely to have occurred. 

Note that the first term in equation 12 is always positive. The 
second term will be negative only when the ratio (2m0DTi/A) is less 
than one. The implication is that there is a limit in time beyond 
which a single detection can not be accepted. With no memory, the 
tracker will stall if he has not accepted a detection by a given time 
limit. With a memory capacity, the tracker is able to weight the 
various combinations of time and space differences between detections. 
In this way he may still accumulate an acceptable track. 

As an example we can look back at the situation developed from 


figure 2. The four summary measures would be 


1) Ly = CX #¥y)°)/(20t, 4) + In(2mpt, 4/2) (13) 
2) by = (Xoq“+¥5q)/(20t,) + In( 2mDt,,/A) (14) 
3) bg = (gy #59) /(20tg7) + In(Xq9 #9) /(2Dt 45) 

+ In(2mDt.,,/2) + In(2mDt,5/A) als) 
4) 4, = 0 (16) 


The trackers rule would be to accept the track with the smallest value, 
update the memory file accordingly, then wait for the next detection 


COnOCCUY . 
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IIIT. TRACKING WITH NO MEASUREMENT ERROR 


For the purpose of examining the value of a new tracking model, it 
is useful to make comparisons with a model already in existence. In 
this section we will examine results of simulating the maximum likeli- 
hood tracker and compare the results with those of Washburn [3], who 
has developed an optimized tracking rule for the memoryless tracker 
with no measurement error. We will then introduce memory to the maxi- 


mum likelihood model and note the improved results. 


A. THE MEMORYLESS TRACKER 

Examining the same problem presented here, Washburn [3] arrives at 
an analytic solution which produces a tracking rule based on detection 
range aS a function of time. Given the dynamic parameters of the 
problem and a detection time, his rule will generate a range from the 
last target position inside which the new detection should be accepted 
as real. Should the detection fall outside that range circle it would 
be rejected as false. The method is relatively easy to implement 
requiring only a single function evaluation for each detection that 
occurs. Based on this algorithm he is able to identify a dimensionless 
curve for AT, faeteceion rate x average tracking time), as a function 
of the rate ratio a. This curve is reproduced in figure 3. He has 
Shown that these are maximum expected tracking times for the memoryless 


tracker with no measurement error. 
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The continuous time Fortran simulation listed at the end of this 
report was designed to examine the effectiveness of the maximum likeli- 
hood decision rule. The dynamic parameters of the program include the 
component parameters of the rate ratio, a, and the accuracy ratio, 8, 
as well aS a memory input which allows for tracker memory set between 
one and ten detections. The case where the tracker’s maximum memory 
capacity is equal to one is the equivalent of Washburn'’s memoryless 
tracker. Using the maximum likelihood memoryless tracker model, it is 
possible to generate a graph similar to that of Washburn'’s. Point 
estimates, based on 1000 iterations at each a level are marked with a 
© in figure 3. Table I shows Washburn's AT, the maximum likelihood 
point estimates, a 95% confidence interval for the point estimates, and 
the sample standard deviation for the maximum likelihood results. 

The results indicate that tracking time for the maximum likelihood 
memoryless tracker is roughly exponential in nature, with the sample 
mean approximately equal to the sample standard deviation. More im- 
portantly, the times are nearly as good as those of Washburn. Wash- 
burn's model was specifically designed to maximize tracking time as 
it is defined in his report. Using the same definition for tracking 
time, we are able to nearly duplicate his results with the simplest 


* version of the maximum likelihood tracker. 


B. THE TRACKER WITH MEMORY 
Having established a tracking algorithm that is nearly the equal of an 


optimized memoryless tracker, our goal will now be to improve upon the 
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WebE {. Dimensionless tracking value, AT, as a function of 
rate ratio, a; 8=0. 


Maximum 95% Confidence Interval Sample 
Washburns Likelihood Lower Upper Standard 
com AT AT Bound Bound Deviation 

] 1.4 eZ ero heey | Qe 
2 253'5 28S ee 2.44 1.83 
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8 14.4 14.04 oye 14.95 io .o6 
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TABLE II. Dimensionless tracking value, AT, as a function of 
memory; a=4, B=0. 


95% Confidence Interval on XT % Improvement 
Lower Upper 109-(At=2-39) 
Memory AT _ Bound Bound ew 
] 5.39 5e08 570 — 
Washburn's AT = 5.45 

2 oper) Bia 3 3) sles! 28 
3 9.84 9.94 6.14 8.3 
4 9.86 5.54 6.18 B27 
5 Oe 5.49 6.15 Ws 
6 8). 310, So Ge23 fF) 
7 5.90 29 Gee | go 
8 B58 52s 5688 35 
Q ba13 aes: 6.48 Yor, @ 
10 Sy S10 3) Bays. 6.22 1.5 
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model by introducing a memory capacity. As stated in part A of this 
chapter, the simulation used in this report was run with as many as 
ten detections on file. At each detection the model evaluates every 
possible label combination for the detections in memory and accepts 
the most likely. Note that the track selected will either include 

the most recent detection or be null. In accordance with the tracking 
rules, when a non-null] track is accepted all but the most recent posi- 
tion estimate are scrubbed from memory. The result is a type of time 
sequenced problem where the number of label combinations to be examined 
actually doubles as each new detection is added to memory. For the 
purpose of this report, a memory capacity of ten detections was found 
to sufficiently illustrate the benefit of memory. Further increases 
in memory capacity are made at a substantial cost in computer process- 
ing time. As will be shown later in this report, the small increase 
in tracking time is not likely to be worth the extra effort required 
for more memory. There appears to be an upper bound on tracking 
ability. The bound is nearly reached with a memory capacity less than 
ten. As the capacity increases tracking time asymptotically 
approaches the upper bound. 

Because of the limited storage capacity, the possibility does exist 
that memory capacity might be exceeded before a detection, or set of 
ae auiens. is accepted. In this case we will have to introduce a 
procedure whereby detections can be selectively purged from memory. 
The question of where to begin memory cleansing stimulates several 


possible approaches. Not only individual detections, but combinations 
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of several detections could be considered to determine which might 
offer the greatest chance of future acceptance. For simplicity, in 
this report the detections will be considered individually, and the 
Single most unlikely detection will be scrubbed. 

Looking now at a specific example, we begin to observe the effect 
of memory. In the case where a=4, 8=0, the incremental effects of 
memory are illustrated in figure 4. A curve, based on 1000 iterations 
at each memory level, has been fitted between the points to roughly 
approximate the shape of the empirical solution. Although not smooth, 
the curve does indicate a significant gain in tracking time as memory 
Capacity is initially expanded to several detections. The curve then 
seems to flatten somewhat, indicating a diminishing return for memory. 
This flattening of the curve, found in every sample run, provided 
justification for limiting memory capacity to ten detections. In 
fact, if computer access were limited, a memory capacity of three or 
four detections might prove sufficient. Table II lists the point 
estimates, 95% confidence intervals, and the per cent improvement over 
base case, memory = 1. 

Although we have reported only one case, the effects of memory 
were found to be universal. Various runs with a ranging from one to 
ten showed the maximum likelihood tracker could consistently outperform 
Washburn's memoryless tracker when equipped with a memory capacity as 
small as two or three detections. In the next chapter we will examine 
the method by which the maximum likelihood tracker is able to handle 


the problem of measurement error. 
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Figure 4. Dimensionless tracking time, XT, and 95% confidence 
intervals as a function of memory; a=4, 6=0. 
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IV. TRACKING WITH MEASUREMENT ERROR 


Measurement error in the detection system is a common problem for 
trackers. In this report the error is assumed to be circular normal. 
This distribution is commonly used in modeling both because of its 
appropriateness for many existing systems and because of its mathemati- 
cal tractability. In this section we will discuss the effects of 
measurement error on the maximum likelihood tracker and expand the 
model to deal with it accordingly. In addition, we will examine the 
results of a computer simulation in which measurement error was 
included. 

To illustrate the added dimension that measurement error imposes, 
we can first look at figure &. The probabilistic term for real target 
position reports can no longer be defined with the simple bivariate 
normal motion equation used in chapter 2. Instead, we will define 
a new expression which accounts for both the motion and the error be- 


tween subsequent position reports. In figure 5, R. 


uy will be the 


vector distance between the target's actual position at times i and 
inde Re will be the measurement error associated with the iTH detec- 
tion. The vector distance between real target detections will be 
called Q.. In this case we have 


oe eo 


QW a Ro + Ro 3 + Re 


+ R 


y=) 
ae) - 08 
| 


ORG FRG iad * Ria 
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* target's real position at time 1 


o target detection at time 1 


Figure 5. Sample set of target position reports and 
associated target positions. 


Since the problem is symmetric in the X and Y dimension, for sim- 
plicity we can examine a one dimensional version of the same problem. 
Since the X and Y components of target motion and error are independent 
and parameterized identically, we will be able to combine terms to form 
a single solution based on the identically distributed but independent 
results. 

In this case the one dimensional, horizontal distance between de- 
tections will be called Ke. The error associated with the iTH detec- 
tion will be called E. and the distance between actual target position 
i and i+] will be Ve. A series of measurements can be represented as 


follows: 
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We know the E and V variables are all independent with means equal to 
zero, that the variance of E. 1s equal to oa and that the variance 
of V. is equal to Dt.. However, the individual measurements, Xs are 
not independent. Since E, is common to both X, and X,, ELX, Xo] = 

- 5. and more generally E[X, X= 474 = + nae Since ET x?} = 20°40t 


the covariance matrix of U, = Ob Sipe for instance, will be 


25°+ Dt, -5° 0 

: 2 2 

%3 - -O 20 + Dt, -0 
0 9° 29°+ Dt 


This matrix retains its form, expanding only along the diagonals, as 
1 
ks) 


is multivariate normal, the probability density function of U. will be 


the dimension is increased. Since the vector U. = (X, ; x 


f(U.) = C= /TE,7 |) exp[- xa] 


Ss 





where i = ye 5 U. and | | denotes determinant [4]. By symmetry, 


the same probability density function holds for the vector of incre- 
mental measurements in the vertical direction, W. = (Y,, Voseees ial 
Since U. and W are independent, the joint probability density function 


is obtained by multiplication: 


F(U;.W,) = ((2m)" [z,])7! expl-d,/2] 


where = = 7 a W. and J. - ae uF i, This then will replace 
the term used in the decision rule developed in chapter 2 . In final 


form, the new expression will be: 

L, 29, + In(2msr)" [E41] 
Note that this is the equivalent of (12) from chapter (2) when o 
equals zero. 

Although the decision rule looks relatively simple when expressed 
in matrix notation, computer implementation of the rule creates 
another problem. To avoid the burden of recomputing 7! and |=| for 
each of the tracks examined, it is necessary to develop an iterative 
procedure by which a summary term can be identified for each of the 
tracks examined. Using a type of Kalman filter, developed mathe- 
matically in Appendix A, it is possible to obtain a position estimate, 
track value (L.), and gain matrix for each of the tracks examined. If 
none of the tracks are subsequently accepted, the terms can be saved 


and used when evaluating the next detection that occurs. The procedure 
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is completely iterative and reduces to the procedure developed in 
chapter (2) when 8 equals zero. A flow chart for the algorithm is 
outlined below with Se = Dt. and d = |r|. See Appendix A for the 


definition of v, x, and y. 


J = 0 
y = 
x = 0 
y = 0 
d = | 
> Observe X, Y, and 54 
v= age + ss - 6 iy 
on 
J+ [lx-x)* + (y-¥)°V/y 


(esa 
= o“(y-Y)/v 





To test the effectiveness of the revised decision rule, we can use 
the Fortran simulation listed at the end of this report. For a sample 
case where a=4 and B=], the sample results from 1000 iterations at 
each memory level are graphed in figure 6. Point estimates, 95% con- 
fidence intervals, sample standard deviation, and the per cent improve- 
ment over base case (memory = 1) are listed in Table III. The results 
are aS we might intuitively expect. Memory capacity again appears to 


benefit the tracker, but the gain appears to level off as memory is 
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Dimensionless tracking time, AT 
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Figure 6. Dimensionless tracking time, AT, and 95% confidence 
intervals as a function of memory; a=4, 8=1. 
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TABLE III. Dimensionless tracking time, AT, as a function of 


Memory 


oOo wo oOo Ns DO FP W FT — 
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TABLE IV. 
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memory; a=4, B=l. 


Dimensionless tracking 
memory; a=8; B=]. 
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At_ Bound Bound Deviation ment 

Ze: 2205 223 | 2.04 — 

2.26 2215 DISS, Do\s Say 
Zee Be thl 2 al) 2.24 oes 
2.44 Ze, 2 Oe, Zhi i2 
290 239 oT noo 1720 
2.47 Ze 2.62 Zo 9 Ses 
2.47 oe 2.62 beste) ros 
ZS | 2.24 2.94 2.34 9.6 
2.60 2.45 Be Jes Zs Shil oes 
Zoey Zao 2.65 2.30 Sean 


time, AT, as a function of 


95% Confidence Interval Sample 70 
Lower Upper Standard [Improve- 
AT Bound Bound Deviation ment 
6.17 6.05 6.29 6.04 — 
6.53 6.40 6.66 6.46 5.6 
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increased beyond four or five detections. Compared to the case where 
B=0, the per cent improvement in tracking time appears to be better 
although the upper bound on tracking time is much less. 

Due to the large sample standard deviation, the 95% confidence 
intervals are also large. Consequently, even with 1000 iterations, 
the point estimates do not produce the smooth curve we might have 
hoped to find for figure 6. To more closely approximate the nature 
of the curve, we will examine the results of 10,000 iterations of a 
test case where a=8 and 8=1. Memory will range from (1) to (4) 
detections. The results are graphed in figure 7, and listed in 
table IV. As expected, the results begin to outline the shape of a 
smooth curve, rising steeply at first, then tapering off to some 


constant value. 
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Dimensionless tracking time, AT 
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Figure 7. Dimensionless tracking time, AT, and 95% confidence 
intervals as a function of memory, a=8, B=1. 
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Y. SUMMARY 


First, looking at the case where there 1s no measurement error 
(8=0), we have seen that the maximum likelihood model presented here 
1s actually a special case of the maximum 1ikelihood model developed 
by Sittler [2]. In this model, when we examine a set of detections, a 
dimensionless "distance" is assigned to every possible combination of 
real detections. The distance is based on a maximum likelihood solution, 
and the combination of detections with the shortest total distance is 
accepted as the target's real track. The method is intuitively 
reasonable and relatively easy to implement with a computer. 

When this method is compared to the optimal memoryless tracker 
developed by Washburn [3], we find that the maximum likelihood memory- 
less tracker is nearly the equivalent. When furnished with even a 


limited memory capacity, we find that the maximum likelihood tracker 





quickly surpasses the optimal memoryless tracker in ability. However, 


the return of increased tracking time for additional memory diminishes 


quickly. There appears to be an upper bound on tracking time which is 
nearly reached with a memory capacity of four or five detections. In 
all cases the distribution of tracking times was found to be roughly 
exponential with the mean approximately equal to the standard deviation. 
In the case where measurement error was not equal to zero, we were 
required to first develop a type of Kalman filter to handle the process 


of obtatning an iterative expression for the "distance" between 
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detections in a set. Once developed, we saw that the case where 8=0 was 
really a special case of this more general problem. The tracking times 
still appear to follow an exponential distribution, and the payoff for 
memory seemed to increase as 8 approached a. 

The question "How much memory is enough?", is particularly relevant 
to the available computational power as well as the importance of minor 
improvements in tracking times. It appears as though we can approach 
the bound with as few as four or five detections; however some smal] 
gain in tracking time will still be realized beyond that memory level. 
The cost of obtaining the small increase in tracking time is a marked 


increase in computer processing time. 
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APPENDIX A 


DEVELOPMENT QF KALMAN FILTER 


We will consider a one dimensional system in which position measure- 
ments are taken sequentially. Target motion between measurements is 


assumed to be the result of normal diffusion and will be represented by 


ey and § es Dt 


Vy» Where Vy ~ NCO, Sy r y- Each position measurement will 


also have an associated measurement error, EN which will also have a 


2 


normal distribution; i.e. EN ~ N(O, o ). The distance between succes- 


Sive measurements will be; 


ee =U eget oN ye ce 


yn = Ey + Vy - Eylys Nad, @, 


The symbol Z, has replaced X, of the text (CH-4) because we will have a 


Special use for the symbol Xu 
Let ay be the covariance matrix of U, = LZ,» Bee eal” and 


N 
a cae Uy. We wish to find an iterative means of producing Jy 


_ t 7 
To begin let Xy = [Ey Ey-14 , SO that Xv, = oXy + Wa; where 


: jm : t _ fa2 0 
WS | ; Wry = (Evy. 0)~, and cov(W,) = E 0 | 


We also have Zn = HXy + Vas where H = [1, -1]. Now let the NxN 


matrix Ly be a whitening filter; i.e. Ly Uy is white noise. Then 


» 2 t 
LAN = cov[L, Un = Ly ay Ly é' 


Using matrix manipulations we obtain 
L “Tey ae = 


N N 


and 
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therefore 


Now let 


Werden Se) So wet 
N 
e iE 2 2 
i=] 
Also let os E[Zy|Z,. «--: Zy_y4 and 
Vy = var [Z,)|Z, ; vee Zy 14 


Then 


—— is independent of Zi» 
VV 


has unit variance; 7.e. 


wae Ly _y> normal, and 


At this point, our intention will be to use Kalman filtering to 
N 
obtain an iterative expression for zy and Vu: Since Jy = £ gue and Z 
1=1 
can be measured, when Zy and vy are available we have an iterative 


N 


expression for Jy: The remainder of this appendix will closely follow 





the Kalman filtering technique used by Gelb [1]. So that our notation 
will conform to his, we will first define the following terms; 


Xy(-) = E[Xy |Z, ; oy Zy_11 : ea 


Sl) = ELK, |Z, » eo Zu] 
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mye) = covlX,|Z,. .-.» Zy 91 
Py (+) covLXy |Z, soy Ly] 


To begin, let oy” = var [E, 1121 > aN oetee Ly ii> Sor Ena t a, ¢ = o¢ and 
2 4 7 =_ 
mC 
Py (=) 2 0 Oy" - Then 
Z t Zee Z 2 
Vy = 4 Py(-) Ho + Sy =o + oy + Sy 


Z 
The Kalman gain matrix, Ky > 1s given by Ky = end. Following 
-o' /V 
N 


the Kalman format, we can update the current error esti- 


mate, xy C+), as follows: 


Xy(+) = xy(-) + Ky LZ, - H xyC-)] 


= 0 | r ee [Z,-0-z4] 
-2, “0° / Vy 


Coad yt | 
-2 -(o°/V¥y)(Zy-2y) 


Since Xv 47 o) = oxy (+) and Zy,, =H Xvaq bo) Zy4, 74H Xv (+) = 
“(0° /v¥y)(Zy-2y) which gives the desired iterative solution for Zy. We 
continue working toward a solution for Vn by first updating the co- 


variance matrix; 


om 0 
Pul+) (I-KH) Py (=) = crx) | ql 


ay” b where ay’ = ea ~ o"/Vy 
“le alle o°(1-0°/vy) 
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Regardless of b, c, and d, we can compute P,,,,(-) as follows; 


N+] 


Pugy i) = > PyuCt)o + cov[Wy J 


a> 8 > , 
= | ay so that Oye] = We 


At this point we have completed the one-dimensional analysis. The 
computations are in the following order (an intermediate computation 
of ay" has been eliminated): 


Setting (aie to initialize the problem 


we have; Z, = Q 
ea Zz 2 2 2 
Uap ee S, +o Clee: IV) 
7 2 


= Z 
on) (2, - Zi )/v, 
2 


< 
i 


og? + Ss, + a (1-0°/v, ) 


Cc, 
il 


2 
2 = 9, + (25-25) /vo 


By using a flow chart we can eliminate the variable subscripts. 


The procedure will] be as follows; 


VY =@ 
z=Q 
J = 0 
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> observe Z and 5¢ 


2 


2 4 
¥Vo= 206° +S = 0 /V 


eee ay 


2 = g* (z = Z)/v 
When we examine a two dimensional, symmetric version of the same 
problem, as considered in the text, we are actually looking at two 


independent but identical problems. In this case we solve for 


ioe, ta. -l Vee te 
Jy = Uy Ly Uy , and Jy = Vn ay N 


in this appendix. Because of the symmetric parameters, we can combine 


V,, uSing the procedure developed 
terms to form a single value J. Ina flow diagram we can compute J as 
follows; J = J+ [(x-x)¢ + (y-VICI/¥ where J is initially set equal to 
zero. This term can then be used in a bivariate normal probability 
distribution used to represent successive real detection positions. 
The entire flow chart for the two dimensional case is shown in 
chapter (4) of the text. 

Using this formulation, we can also find a way to iteratively 
calculate the value of JE. . As previously defined Q, = LyUy and 


; oo. t | ee ee 
cov[Q] = EQ, Qn ] = Ly Zy by = Iyyy2so that cov [Uy] = Ty aly (Ly a 


Since Ly will be a lower rectangular matrix with the jen diagona| 
element equal to V/vv., we have; \ 
1 
[t= se [| 
i=] 





and therefore; 
N 


1 ] ; 
|Zy| = ea ecince 
N [Ly | by =; 1 
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|AB| = |A; |B| and lanl : ayn), This then will be the iterative 


solution for JEy |» as is also shown in the flow diagram of chapter 4. 
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